ImpactMojo ImpactMojo
Premium

MEL 101

Foundations of Monitoring, Evaluation & Learning
ImpactMojo Workshop Series • Building Evidence for Development Impact
75-90 Minutes

Workshop 1: MEL Frameworks & Theory of Change Development

Target Audience: Development practitioners, program managers, NGO staff, researchers, and policy analysts working on social development programs

Prerequisites: Basic understanding of development programs and project management

Materials Needed: Sticky notes, flip chart paper, markers, sample program documents

Learning Objectives

By the end of this workshop, participants will be able to:

Part 1: What is MEL and Why Does it Matter?

20 minutes

Opening Scenario: Two NGOs, Different Approaches

NGO A: Implements a girls' education program for 3 years, collects attendance data monthly, conducts final evaluation, reports 85% attendance rate as "success."

NGO B: Implements similar program, tracks attendance plus learning outcomes, family attitudes, teacher capacity. Uses data quarterly to adjust program design. Discovers attendance is high but learning is low—pivots to teacher training focus.

Question: Which approach is more likely to create lasting change? Why?

Understanding MEL: Three Interconnected Functions

Monitoring

Purpose: Track progress and performance

  • Ongoing data collection
  • Performance against targets
  • Early warning systems
  • Accountability to stakeholders

Example: Monthly tracking of girls enrolled, attendance rates, dropout reasons

Evaluation

Purpose: Assess effectiveness and impact

  • Systematic assessment
  • Causal attribution
  • Value for money analysis
  • Evidence for scaling

Example: Comparing learning outcomes of program girls vs. control group

Learning

Purpose: Generate insights for improvement

  • Reflection and adaptation
  • Knowledge management
  • Continuous improvement
  • Innovation and iteration

Example: Understanding why some girls succeed despite barriers—scaling effective approaches

Why MEL Matters: The Evidence-to-Impact Pipeline

Strong MEL systems don't just measure—they drive better outcomes by:

  • Improving program design through real-time feedback
  • Increasing accountability to beneficiaries and funders
  • Building evidence for policy and practice change
  • Facilitating scaling of effective interventions
  • Contributing to sector knowledge and innovation

Part 2: Theory of Change - Your Program's Story of Change

25 minutes

What is a Theory of Change?

Definition: A comprehensive description and illustration of how and why a desired change is expected to happen in a particular context.

Key Components:

  • Long-term outcomes: The ultimate change you want to see
  • Preconditions: What must happen for change to occur
  • Assumptions: Beliefs about how change happens
  • Activities: What you will do to catalyze change
  • Context: External factors that influence change

Building a Theory of Change: Step-by-Step Process

Impact

Long-term sustainable change

Reduced gender inequality in education

Outcomes

Medium-term changes in behavior/conditions

Girls complete secondary education

Outputs

Direct products of activities

Girls enrolled in school, teachers trained

Activities

What you do

Scholarship program, teacher training

Inputs

Resources invested

Staff, funding, materials

Theory of Change Workshop (15 minutes)

Scenario: Design a Theory of Change for improving maternal health in rural areas.

Context:

  • High maternal mortality in remote villages
  • Limited access to skilled birth attendants
  • Cultural barriers to facility-based delivery
  • Poor transport infrastructure

Your Task (work in pairs):

  1. Start with Impact: What's the ultimate change you want? (3 minutes)
  2. Work backwards to Outcomes: What changes need to happen first? (4 minutes)
  3. Identify Outputs: What products/services will create these changes? (3 minutes)
  4. Design Activities: What will you actually do? (3 minutes)
  5. List key Assumptions: What must be true for this to work? (2 minutes)

Reflection: What are the critical assumptions that could break your theory?

Strong Theory of Change Characteristics
  • Plausible: Links between levels make logical sense
  • Feasible: Achievable given context and resources
  • Testable: Assumptions can be verified through evidence
  • Specific: Clear about who, what, where, when
  • Evidence-based: Grounded in research and experience

Part 3: Indicators - Making Change Measurable

20 minutes

Types of Indicators

Indicator Type Purpose Example (Girls' Education) Data Source
Input Indicators Resources invested Number of teachers trained Training records
Output Indicators Products/services delivered Number of girls enrolled School registration
Outcome Indicators Changes in people's lives Girls' learning achievement levels Test scores, assessments
Impact Indicators Long-term change Gender parity in employment Labor force surveys

SMART Indicators Framework

Making Indicators SMART

S - Specific

Clear about what is being measured

Poor: "Improved health"

Good: "Reduced under-5 mortality rate"

M - Measurable

Quantifiable with clear units

Poor: "Better nutrition"

Good: "Percentage of children with normal weight-for-height"

A - Achievable

Realistic given context and resources

Consider: Baseline levels, timeframe, external factors

R - Relevant

Directly related to objectives

Test: Does this indicator tell us if we're achieving our goal?

T - Time-bound

Clear timeframe and target

Example: "80% by December 2024"

Indicator Development Practice (8 minutes)

Challenge: Develop SMART indicators for this outcome: "Improved financial inclusion among women entrepreneurs"

Your Task:

  1. Write 3 different indicators that could measure this outcome
  2. Choose the best one and make it SMART
  3. Identify potential data sources
  4. Consider what might make this indicator misleading
Indicator SMART Elements Data Source Potential Issues
Your indicator: S:___ M:___ A:___ R:___ T:___
Common Indicator Pitfalls
  • Indicator fixation: Measuring what's easy rather than what matters
  • Too many indicators: Data burden overwhelms learning
  • Attribution confusion: Measuring changes you can't influence
  • Gaming: Perverse incentives that distort behavior
  • Static indicators: Not adapting as programs evolve

Part 4: Data Collection Strategies

15 minutes

Choosing Data Collection Methods

Quantitative Methods
  • Surveys: Baseline, midline, endline studies
  • Administrative data: School records, health registers
  • Service statistics: Program participation data
  • Observation: Structured checklists, audits

Strengths: Standardized, comparable, good for trends

Limitations: May miss nuance, context, explanations

Qualitative Methods
  • Interviews: Key informants, beneficiaries
  • Focus groups: Community discussions
  • Observation: Ethnographic, participatory
  • Case studies: In-depth program stories

Strengths: Rich detail, explanations, unexpected insights

Limitations: Not generalizable, resource-intensive

Participatory Methods
  • Community mapping: Local problem identification
  • Most Significant Change: Story collection
  • Outcome harvesting: Verifying changes
  • Social accountability: Citizen feedback

Strengths: Ownership, local knowledge, empowerment

Limitations: May lack rigor, time-consuming

Digital/Tech-Enabled
  • Mobile surveys: KoBo, SurveyCTO
  • SMS polling: Real-time feedback
  • Digital diaries: Self-reporting tools
  • Sensor data: Automated monitoring

Strengths: Real-time, cost-effective, reduces errors

Limitations: Digital divide, technical skills needed

Data Collection Best Practices
  • Mix methods: Triangulate for fuller picture
  • Start simple: Build systems gradually
  • Use existing data: Don't collect what already exists
  • Build capacity: Train staff on data quality
  • Close the loop: Share findings with data providers
  • Consider burden: Balance learning needs with respondent time

Part 5: MEL System Design Principles

10 minutes

Building Effective MEL Systems

1. Fit for Purpose

  • Aligned with program objectives and stakeholder needs
  • Appropriate complexity for organization capacity
  • Responsive to decision-making requirements

2. Participatory and Inclusive

  • Involves beneficiaries in design and implementation
  • Multiple stakeholder perspectives included
  • Accessible to different literacy and technology levels

3. Learning-Oriented

  • Regular reflection and adaptation cycles
  • Safe spaces for discussing failures and challenges
  • Knowledge management and institutional memory

4. Cost-Effective

  • Proportionate investment (typically 5-10% of program budget)
  • Leverage existing data sources where possible
  • Focus on critical questions rather than comprehensive measurement

5. Ethical and "Do No Harm"

  • Respect beneficiary privacy and consent
  • Consider potential negative consequences of data collection
  • Ensure data security and appropriate use

MEL as a Management Tool

Remember: MEL is not an add-on to programs—it's an integral management function that:

  • Informs strategic planning and adaptive management
  • Enables evidence-based decision making
  • Strengthens accountability to all stakeholders
  • Contributes to sector learning and innovation
  • Demonstrates impact for sustainability and scaling

Essential MEL Resources

Foundational Reading:

Indian Development Context:

Practical Tools and Platforms:

Professional Networks:

Data Sources for Context:

Next Steps in ImpactMojo: